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AMENDMENTS TO THE CLAIMS 

I, -9. (Canceled) 

10, (Currently Amended): A computer-implemented m ethod p e rformed in a comput e r bas e d 
syst e m comprising the steps of: 

a) receiving a path drawn by a user via a stylus as input, the path defining boundaries of a 
selected on-screen region of a display, wherein pixels comprising one or more graphical 
elements being -are displayed in the selected on-screen region; 

b) capturing the pixels displayed within the selected on-screen region, and storing the 
captured knage-pixels in an image file such that the image file is representative of only those 
pixels of the display within the selected on-screen region; 

c) receiving a user command to annotate the one or more graphical elements and, in 
response to the user command, receiving an annotation drawn by the user on the display via the 
stylus: and 

d) _e)— obtaining context information for the one or more graphical elements by 
automatically applying text recognition to aa -the annotation drawn by the user on the display via 
the stylus in proximity of the selected on - scrocn region , and storing the results of the text 
recognition as context information, 

wherein the context information is automatically stored in association with the image file. 

II. (Currently Amended): The method according to claim 10, wh e r e in st e p c) further 
compris ing: esf 

determining a window associated with the selected on-screen region; 

retrieving an application interface having a Uniform Resource Identifier (URI) property 
from the determined window or a parent window of the determined window; and 

obtaining the URI property as the -additionat context information , the additional context 
information being automatically stored in association with the image file . 



12.-14. (Canceled) 
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1 5 . (Previously Presented): The method of claim 10, further comprising: 

creating and storing a linking structure as the association between the image file and the 
context information. 

16. (Canceled) 

17. (Previously Presented): The method of claim 15, wherein the linking structure is 
incorporated in a file separate from the stored image file and the stored context information. 

18. (Previously Presented): The method of claim 15, wherein the linking structure includes at 
least one pointer pointing to the stored image file or the stored context information. 

19. (Canceled) 

20. (Previously Presented): The method of claim 10, wherein the context information is stored in 
such a manner as to be accessible to a user for performing at least one of the following: 

searching for said image file, 

displaying the context information simultaneously with the captured image pixels, and 
navigating a network to a source of the captured image pixels. 

21. (Currently Amended): The method of claim 10, wherein the one or more graphical elements 
representing a first set of one or more textual characters, the method further comprising: 

obtaining fee -additional context information by extracting the first set of one or more 
textual characters, extracting a second set of textual characters displayed in proximity with the 
first set, and storing the first and second sets of textual characters as the additional context 
informatio n, the additional context information being automatically stored in association with the 
image file . 
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22. (Currently Amended): The method of claim 10, wherein the selected on-screen region is part 
of displayed textual region, and the graphical elements comprise a first set of one or more textual 
characters displayed in the textual region, the method further comprising: 

obtaining &e -additional c ontext information based on a second set of one or more textual 
characters displayed in the textual regio n, the additional context information being automatically 
stored in association with the image file . 

23. (Canceled) 

24. (Currently Amended); The method of claim 27, 10, wh e r e in th e st e p c) further compris ing: 

©St 

digitizing movements of a stylus across the display in order to receive the-an annotation; 

and 

obtaining the -additional context information based on the received annotatio n, the 
additional context information being automatically stored in association with the image file . 

25. (Currently Amended): The method of claim 10, wherein the selected on-screen region 
includes at least a portion of a displayed web page or document, and the s tep - dV method further 
comprises: 

using an application programming interface (API) to query the-an application for the 
additional context informatio n, the additional context information being automatically stored in 
association with the image file, the queried application causing the one or more graphical 
elements to be displayed . 

26. (Currently Amended): The method of claim 25, wherein the st e p d) further compris ing: e s 
obtaining a uniform resource identifier (URI) of the web page or document as the context 
information, the URI being obtained as a result of the query using the API. 
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27. (Currently Amended): A computer-implemented method performed in a stylus-based 
computer system comprising the steps of: 

receiving a path drawn on the display by a user via a stylus, the drawn path defining the 
boundaries of a selected on-screen region of the display , the selected on-screen region 
comprising a plurality of pixels : 

capturing the plurality of p ixels within the boundari e s of the on-screen region; 

storing the captured pixels as an image file such that the image file is representative of 
only those pixels of the display within the on-screen regio n, wherein the content displayed within 
the on-screen region includes textual data or underlying data comprising at least one of an 
executable object a file, and a link to remote content ; 

automatically detemiining whether the content displayed within the on-screen region 
includes textual data; 

when the displayed content of the on-screen region is determined to include textual data, 
automatically extracting a character or word from the textual data as context information; 

automatically determining whether the displayed content of the on-screen region includes 
underlying data comprising at least one of: an executable object, a file, and a link to remote 
content; 

when the displayed content of the on-screen region is determined to include the 
underlying data, automatically extracting a property of the underlying data as context 
information, the property comprising at least one of: a file name, a file identifier, a uniform 
resource locator (URL), a uniform resource identifier (URI), a folder name, and meta-data; and 

storing the extracted context information and th e additional cont e xt information, if any, in 
association with the image file, such that the context information is accessible when viewing the 
image file. 

28. (Currently Amended): A method performed in a stylus-based computer system comprising 
the steps of: 



Birch, Stewart, Kolasch & Birch, LLP 



5 



Application No. 1 0/766,3 1 9 Docket No. : 5486-0 1 74PUS 1 

Amendment dated December 30, 2008 
Reply to Office Action of October 1, 2008 

receiving a path drawn on the display by a user via a stylus, the drawn path defining the 
boundaries of a selected on-screen region of the displa y, the selected on-screen region 
comprising a plurality of pixels; 

capturing the plurality of p ixels within the boundari e s of the on-screen region; 

storing the captured pixels as an image file such that the image file is representative of 
only those pixels of the display within the on-screen regio n, wherein the content displayed within 
the on-screen region includes at least one of: textual data, an executable object, a file, and a link 
to remote content ; 

receiving a user command to annotate the content displayed within the on-screen region; 
in response to the user command, r eceiving an annotation drawn on the display by the 
user via the stylus; 

performing text recognition on the annotation to produce recognized text of the 
annotation as context information; 

automatically determining that the content displayed within the on-screen region includes 
at least one of textual data and underlying data comprising at least one of an executable object, a 
file, and a link to remote content; 

automatically extracting as additional context information at least one of: 

a character or word from textual data determined to be included in the on-screen 

region, and 

a property of underlying data determined to be included in the on-screen region, 
the property comprising at lest one of: a file name, a file identifier, a uniform resource locator 
(URL), a uniform resource identifier (URI), a folder name, and meta-data; and 

storing the context information and the additional context information in association with 
the image file, such that the context information is accessible when viewing the image file. 

29. (New): The method of claim 27, wherein 

the content of the selected on-screen region includes both textual data and underlying 
data comprising at least one of: an executable object, a file, and a link to remote content, and 
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both the extracted property of the underlying data and the extracted character or word are 
stored in association with the image file. 
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